Stochastics of on-line back-propagation
نویسنده
چکیده
We study on-line backpropagation and show that the existing theoretical descriptions are strictly valid only on relatively short time scales or in the vicinity of (local) minima of the backpropagation error potential. Qualitative global features (e.g., why is it much easier to escape from local minima than from global minima) may also be explained by these local descriptions, but the current approaches cannot give accurate quantitative predictions of global properties (e.g., how long does it take to reach the global minimum starting from a local minimum).
منابع مشابه
On the use of back propagation and radial basis function neural networks in surface roughness prediction
Various artificial neural networks types are examined and compared for the prediction of surface roughness in manufacturing technology. The aim of the study is to evaluate different kinds of neural networks and observe their performance and applicability on the same problem. More specifically, feed-forward artificial neural networks are trained with three different back propagation algorithms, ...
متن کاملPhysical modelling of caving propagation process and damage profile ahead of the cave-back
The cavability assessment of rock mass cavability and indicating the damage profile ahead of a cave-back is of great importance in the evaluation of a caving mine operation, which can influence all aspects of the mine operation. Due to the lack of access to the caved zones, our current knowledge about the damage profile in caved zones is very limited. Among the different approaches available, p...
متن کاملPredicting air pollution in Tehran: Genetic algorithm and back propagation neural network
Suspended particles have deleterious effects on human health and one of the reasons why Tehran is effected is its geographically location of air pollution. One of the most important ways to reduce air pollution is to predict the concentration of pollutants. This paper proposed a hybrid method to predict the air pollution in Tehran based on particulate matter less than 10 microns (PM10), and the...
متن کاملApplication of McCoy Cell Line for Propagation of Herpes Simplex Virus Type 1
Herpes simplex virus types 1 (HSV-1) and 2 (HSV-2) are members of the Herpesviridae family. About 40% to 80% of the world populations are infected with HSV and its prevalence is high in Iran. The high prevalence of this virus in the community and the ability of the virus in causing fatal diseases among immunocompromised patients, have encouraged studies to be performed on HSV and suitable cell ...
متن کاملEstimation of pull-in instability voltage of Euler-Bernoulli micro beam by back propagation artificial neural network
The static pull-in instability of beam-type micro-electromechanical systems is theoretically investigated. Two engineering cases including cantilever and double cantilever micro-beam are considered. Considering the mid-plane stretching as the source of the nonlinearity in the beam behavior, a nonlinear size-dependent Euler-Bernoulli beam model is used based on a modified couple stress theory, c...
متن کامل